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Abstract 


In this paper, a generalized version of the auto-convolution Volterra inte- 
gral equation of the first kind as an ill-posed problem is studied. We apply 
the piecewise polynomial collocation method to reduce the numerical solu- 
tion of this equation to a system of algebraic equations. According to the 
proposed numerical method, for n = 0 and n = 1,...,N —1, we obtain a 
nonlinear and linear system, respectively. We have to distinguish between 
two cases, nonlinear and linear systems of algebraic equations. A double 
iteration process based on the modified Tikhonov regularization method is 
considered to solve the nonlinear algebraic equations. In this process, the 
outer iteration controls the evolution path of the unknown vector ue in the 
selected direction tio, which is determined from the inner iteration process. 
For the linear case, we apply the Lavrentiev m times iterated regulariza- 
tion method to deal with the ill-posed linear system. The validity and 
efficiency of the proposed method are demonstrated by several numerical 
experiments. 
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1 Introduction 


Auto-convolution equations have been investigated by mathematicians in var- 
ious fields. Some of the applications of auto-convolution equations are in 
spectroscopy, stochastic, and probability theory. In 1990, for a deeper un- 
derstanding of mathematics and applied numerical analysis of stochastic [19], 
inverse deconvolution problems were made as a class of problems in continu- 
ous spaces. Auto-convolution Volterra integral equations (AVIEs) of the first 
kind, 


g(t) -{ u(t — s)u(s)ds, (1) 


as an ill-posed problem, have been studied in [3, 5, 6, 9]. Conditions for the 
compactness, injectivity, and weakly closed of the associated integral operator 
in (1) have been studied in [9]. Also, the authors applied the Tikhonov regu- 
larization for the nonlinear ill-posed problem (1) together with an approach 
to defining different levels and degrees of ill-posedness in Hilbert spaces. In 
[3], the authors have developed a local regularization theory for the nonlinear 
inverse auto-convolution problem (1), which provides regularization methods 
to preserve the causal nature of the auto-convolution problem. Also, they 
investigated the convergence of the regularized solutions to the true solution 
as the noise level in the data shrank to zero and supplied convergence rates 
for the cases of both L? and continuous data. For confluent hypergeometric 
functions, a class of auto-convolution equations of the first kind was derived 
in [23] and a further class of auto-convolution equations of the first kind with 
Mittag-Leffler type functions as solutions was treated. In [5], the authors 
have presented new results concerning the ill-posedness character of the non- 
linear auto-convolution equation (1) and discussed quasi-solutions restricted 
to specific (relatively) compact subsets together with limitations of Fourier 
transform techniques for analyzing the auto-convolution problem. Some reg- 
ularization methods and specific numerical approximations applied to the 
first kind of integral equations as well as the equation (1) were also discussed 
in [10, 11, 12, 7, 18, 2, 22, 3, 1, 24, 26, 28, 29, 30, 4, 13, 25, 16]. The auto- 
convolution equation (1) is an interesting example of a nonlinear ill-posed 
operator equation with interesting properties. We can consider important 
properties from [9] in the following form: 


The auto-convolution operator F' : L?(0,1) —> L?(0,1) is defined by 
t 
[F'(u)](t) := | u(t — s)u(s)ds, 0<t<1, 
0 


with a domain 


D(F) := {u € L7(0,1) : u(t) > 0 ae. on (0, 1]}. (2) 
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The operator F’ is continuous, weakly closed but not compact; see [9]. On 
the other hand, for all u* € D(F’), the Fréchet derivative of F as a compact 
linear operator can be defined by 


[F’ (u*)u](t) = 2 f u*(t — s)u(s)ds, G71, 


and also, we have 
||F(u) — F(u*) — F’(u*)(u — u*)[12(0,1) $ llu — u* lIZ2¢0,1)- 


Using the Titchmarsh convolution theorem [20], the injectivity of the 
auto-convolution operator F’ and solutions of (1) can be given by the following 
theorem. 


Theorem 1. [6] For any u € L7(0,1), let 
e(u) :=sup{0 <e <1: u(t)=Oae. on [0,€]}. 


Then the auto-convolution equation (1) together with (2) has a unique solu- 
tion if and only if e(g) = 0. If u* € D(F) is the uniquely determined solution, 
then it fulfills the condition e(u*) = 0 


In this paper, we consider the generalized AVIEs of the first kind as 


‘i Kine siege. FET 1041, (3) 


where g, K are given functions and u(t) is unknown function. Recently, in 
[8], the authors have studied an ill-posed inverse problem of auto-convolution 
equation such that this inverse problem occurs in nonlinear optics in the con- 
text of ultrashort laser pulse characterization. They applied an iterative 
regularization approach, which is specifically adapted to the physical situ- 
ation in pulse characterization, using a nonstandard stopping rule for the 
iteration process of computing regularized solutions. In [27], an AVIE of the 
second kind was solved by using the collocation method according to piece- 
wise polynomials, and the (super) convergence of the mentioned method has 
been studied. However, as far as we know, it seems to be an open problem 
under what conditions we can consider for the kernel in the integral equation 
(3) to investigate the solutions of this equation similar to Theorem 1. 

Here, we consider the numerical collocation method based on piecewise 
polynomials to solve (3). According to the proposed numerical method, we 
have to distinguish between two cases, nonlinear and linear systems. Since the 
auto-convolution problem (3) is ill-posed, for given g, the solutions u need 
not be uniquely determined and mainly small perturbations in the right- 
hand side g caused by noisy data may lead to arbitrarily large errors in 
the solution. To overcome the negative consequences of ill-posedness, we 
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consider a novel double iteration process from [21] and the Lavrentiev m 
times iterated regularization method [14] to deal with the ill-posed nonlinear 
and linear algebraic systems, respectively. 


2 Collocation methods 


Let I, be a uniform partition of the interval J with grid points 
ty, = nh, n=0,...,N, 


and let h be the stepsize. We consider polynomial spline approximations 
un(t) of the exact solution u(t) in the spline space 
go 


m—-1 


(In) = {v: vo, € Mm 1(0<n< N-1)}, (4) 


where v|,,, is the restriction of v to the subinterval o, = [tn,tn4i], and 
Tm—1(m > 1) denotes the set of real polynomials of degree not exceeding 
m—1. Let the collocation parameters be 0 < cy < co < +--+ < Cm <1 and 
let the collocation points be tn; = tr + ahs j=1,...,m,n=0,...,N—-1. 
Hence, our collocation solution uj, € S>* ; (IIp) is déterisined by 


= | K(t, s)upn(t — s)un(s)ds, (5) 


where the collocation equation is satisfied for t = tn;,j = 1,...,m,n = 
0,...,.N—1. We consider the approximate solution on the subinterval a, as 
m 
Unlo, = Un(tn + sh) )= 5°51, (s) Uy 4 s € (0, 1], (6) 
j=l 


where Up; = Un(tn + ¢jh) and 


m 


8 — Cj . 
L;(s) := II = j=l,...,m. 
i=1izj 7 


Inserting (6) into (5), we obtain 
thi 
g(tn,i) =| K (tna, 8)Un(tni — 8)un(s)ds 
0 
tni 
=| K (tris 8)Ud (tn — s)up,(s)ds 
t 


n 


nl pty i 
+S¢ K(tni,8)u"—* (tra — 8)uk (s)ds 
k=0 7 tk 
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n-1 tet 
+S¢ i K (tn ,8)ur—*" (ty 4 — 8) uk (s)ds. (7) 
k=0 ki 


System (7) for n = 0 is a nonlinear system, and for n = 1,...,N —1, it is 
a linear system. Then we have to distinguish between two cases, n = 0 and 
n=1,...,N-1. 


2.1 Double iteration process to solve ill-posed nonlinear 
algebraic systems 


Case I: n = 0. Now (7) becomes 


ch 
g(cih) =) K (ch, s)up (eh — s)u?,(s)ds 
0 


=: i "eth, i en-au ConNas 
0 


=h > a K (qh, sh)L;(c; — s)Lp(s)ds up, (cjh)up, (gh) 


jk=1 
=h S- a uf (ejh)ud, (cub) =h S- a Uo jUo,k, (8) 
jk=1 jk=1 


where 
a = [ K (ch, sh) L;(c; — 8) Ly,(s)ds. 
Nonlinear system (8) can be written as 
f(Uo) — Go =0, or F(Up) =9, (9) 
where 
Up = (Uo,1,;---;Uom)’ €R™, Go = (g(crh),.-., 9(Cmh))” 
Let us assume that g® is an available approximation of g satisfying 


6 
lla” —gll <4, 


where 6 is a given noise level. 


Now, we consider a novel double iteration process from [21] to deal with 
the ill-posed nonlinear algebraic equation system (9). The proposed method 
combines the residual norm based algorithm and the modified Tikhonov’s 
regularization method. For the outer iteration process, the evolution path 
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of the unknown vector follows the searching direction determined from the 
inner iteration process, and the process requires the path falls on the space- 
time manifold such that the convergence rate can be guaranteed. For the 
inner iteration, the direction of evolution u is determined by solving a linear 
algebraic equation 
B’ Bi = B'F, 

where B is the Jacobian matrix. For an ill-posed system, this linear algebraic 
equation is very difficult to solve since the resulting leading coefficient matrix 
is ill-posed in nature. The modified Tikhonov’s regularization method [15] is 
adapted to solve the ill-posed linear algebraic equation. However, for ill-posed 
problems to really find the solution of v may require too many iteration steps 
for the modified Tikhonov’s regularization method, which makes the whole 
numerical process not economical at all. Therefore, the inner iteration process 
stops while the direction u makes the value of Gp smaller than the selected 
margin @, or when the number of inner iteration steps exceeds the maximum 
tolerance — For the outer iteration process, it terminates once the root 
mean square error for the residual is less than the convergence criterion € 
or when the number of inner iteration steps exceeds the maximum tolerance 


Imax * 


Now, first, we consider a perturbed version of the system (9) as 
F°(U3) =0, (10) 


where F°(U@) = f(U?) — G3. Then, we proposed a double iteration process 
for system (9) based on the following algorithm. 


Remark 1. Let 6; = (a1,...,2n)" and let 02 = (y1,-..,Yn)’. Then the 
root mean squared error (RMSE) is defined as 


REMS(6,, 62) = 


Remark 2. From [21], the value of a, is suggested to be in the range of 
2.5 to 4, and the value of Toes actually depends on the selection of a. such 
that it is suggested to be in the range of 30,000 to 80,000. The selection 
of ¢ depends on the system we want to solve. If the system is a well-posed 
system, then the value of € can be very small, and also, if the system is an 
ill-posed system, then the value of ¢ should not be very big. 
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Algorithm 1 Double Iteration Process (DIP) 


Step 1. Give initial guess ue ande,a, oes Ac. 
Step 2.Outer Iteration: For k = 0,1,2,... Repeat 
Compute F* = F§(Ue*) and the Jacobian matrix B, = B(US*). 


BrRe 
Step 3. Inner Iteration: Give the initial guess of u as to = BTR 
kk 


For p = 1,2,..., Imax, Solve tipy1 by (BE By +al)tipy1 = BY F) + attip, 


Compute Up41 = Brttp+1, 


ny LRP lee sal? 
Int) = (CREP Gp yi)?” 


(a) If M41 < Ge, then me = pti, tte = Upyi, Ue = Vp41 and one ter- 
minates the inner iteration; otherwise, continue. 


(b) If p = Imax, then terminate the whole process. 
Step 4. End of Inner Iteration: 
Calculate rz, = ||1 — +l 


Uy = Uy" —(L— re) 


If RMSE < e or (b) is true, then the outer iteration process 
stop; otherwise, continue. 


End of Iteration Process. 


2.2 The Lavrentiev regularization method to solve 
ill-posed linear algebraic system 


Case I: For n = 1,...,.N — 1, we can rewrite system (7) as 


g(tni) =n | K(tnistn + sh)u? ((c; — s)h)u® (tn + sh)ds (11) 
0 


+h | " K (tri, sh) UP (tin + (ce — 8)h)u2 (sh)ds 
0 
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n—1 


+hy- K (trasti + sh)ut—"(ta1 + (ci — 8)h)ub, (ty + sh)ds 
1=1 79 


n—1 1 
+h i) K(tnasty + shut" (ty _1 + (ce; — shud (ty + ah)des. 
1=0 %% 
Using (6), we have 


h ba | K(tna; tn + sh)L; (ci _ 8) Lx (s)dsU0,jUn,k (12) 
j,k=1"9 


+h S- | K(tna; sh)L;(s) L(G _ s)dsUo ;Un,x 
j,k=1 "9 


n—-1l m™m Ci 
oe eS | Ke pail ail th 
l=1 j,k=1"9 


n-l mm 1 
—hSS SS | K(tn iste + sh)Lj(1 + ej — 8) Le(s)dsUp—1-1,3 Ui - 
I=0 j,k=1" % 


Linear system (12) can be written as 


AnUn = Yn, (13) 


Un = (Una, heey Cea € R”, Gy, = (ote) seen Gia) 4 


and Y, = f(Uo,..-,;Un-1) + Gn. Since Up,...,Un—1 have been determined in 
the previous steps, then Y,, is a definite m-dimensional vector. A perturbed 
version of the discrete system (13) may be considered as follows: 


(An + GnD)Ue = ¥/. (14) 


Now , we apply the Lavrentiev m times iterated regularization method [14] 
for the fixed integer m > 1, and the regularization parameter @,, > 0 for the 
equation (13), which determines U? based on the following algorithm. 

Further issues related to theoretical analysis of the Lavrentiev-iterated 
method can be found in the references [14, 17]. 


3 Numerical results 


Two examples are considered in this section, which provides evidence of the 
effectiveness of the proposed numerical methods applied to the first-kind 
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Algorithm 2 The Lavrentiev m times iterated regularization method 


Step 1. Give N, m. 


Step 2.Outer Iteration: For n = 1,2,...,N —1 Repeat 


Determine A, and wey 


Choose initial guess U®° and Gp, . 


Step 3. Inner Iteration: For p= 1,2,...,m, 


solve U5? by (An + GnL)US? = G,USP-1 + Y5 


If RMSE(U*?, U%?-1) + 0, then stop the iteration, change @,,, and consider 
the inner iteration with the new @,,. 
Step 4. End of Inner Iteration: 


put ue? = uae 


End of Iteration Process. 
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fe) a. 
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Figure 1: 


Log|RMSE] versus the number of iteration steps with N = 4,6 = 0 for 


5 10 15 20 25 3 
Number of iteration steps for the outer loop 


he 


outer loop in Example 1 (left). The value of 7 never exceeds the critical value @, = 2.5 
in Example 1 (right). 


auto-convolution equation. We produce the perturbed data g° by adding 
uniformly distributed noise from the interval [—dg, 6g] to the discrete values 
of g(t) for t =tyi,n =0,...,N—1,1=1,...,m. All the computations were 


performed by Wolfram Mathematica 10.0. 


Example 1. Consider the AVIE of the first kind as follows: 
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Figure 2: Log|RMSE] versus the number of iteration steps with N = 8,6 = 0 for the 
outer loop in Example 1 (left). The value of 7 never exceeds the critical value @, = 2.5 


in Example 1 (right). 
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Figure 3: Log|RMSE] versus the number of iteration steps with N = 4,5 = 10~® for the 
outer loop in Example 1 (left). The value of 7 never exceeds the critical value @. = 2.5 
in Example 1 (right). 


t 
sis | cal eue—ouas, ee \oal (15) 
0 
where g(t) = —2500e~'(t + tcost — 2sint) and the exact solution u(t) = 
50te*. 


Let m = 3, let N = 4,8 and let the collocation parameters be cy = 
0.4, cg = 0.6,c3 = 1. For n = 0, we have the following nonlinear system: 


3 
eM =h > ae Ue, 4=1,3,3; (16) 
jk=l 
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Figure 4: Log|RMSE] versus the number of iteration steps with N = 8,5 = 10~® for the 
outer loop in Example 1 (left). The value of 7 never exceeds the critical value @, = 2.5 
in Example 1 (right). 
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Figure 5: The absolute errors with N = 4,6 = 0 at the grid-points in Example 1 (left). 
The absolute errors with N = 8,5 = 0 at the grid-points in Example 1 (right). 


where 
aN = | cos(cjh _ sh) Lj (ci _ s)Lx(s)ds, 1,9; k = 1,2,3. 


For 6 = 0,10~°, we use the double iteration process (Algorithm 1) to solve 
this problem with the initial guess ue" = (1,1,1)7 and the parameters 
a = 0.1,fmax = 30000,@, = 2.5 and « = 1074. Figures 1-4 show that 
for N = 4 and N = 8 with 6 = 0,10~° the process terminates after 29 and 43 
steps for the outer loop, respectively. Also, we observe that 7 never exceeds 
the critical value a4, = 2.5, which once more shows that this method really 


can guarantee the trajectory of the solution vector falls on the manifold. We 
report the solutions of system (16) in Table 1 and use these values to solve 
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Figure 6: The absolute errors with N = 4,5 = 10~® at the grid-points in Example 1 
(left). The absolute errors with N = 8,6 = 10~° at the grid-points in Example 1 (right). 
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Figure 7: Log|RMSE] versus the number of iteration steps with N = 4,6 = 0 for the 
outer loop in Example 2 (left). The value of 7 never exceeds the critical value @ = 2.5 
in Example 2 (right). 


the following linear system by the Lavrentiev ™m times iterated regularization 
method, forn =1,...,N—-1: 


3 


hy? / cos|tn,i — (tn + sh)|L; (ci — s)Lp(s)dsU§, ;US 5 (17) 
j,k=179 
3 be 
+h So / cos[tn,; — sh]L;(s)Le(ci — s)dsU§, ;U2 
j,k=1" 9 


3 Ci 
= 9°(tni)—h S- / cos|tn,s — (t1 + sh)]L; (ci — 8)Lx(s)dsU2_, ;UP, 
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Figure 8: Log|RMSE] versus the number of iteration steps with N = 8,6 = 0 for the 
outer loop in Example 2 (left). The value of 7 never exceeds the critical value @, = 2.5 
in Example 2 (right). 
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Figure 9: Log|RMSE] versus the number of iteration steps with N = 4,5 = 10~* for the 
outer loop in Example 2 (left). The value of 7 never exceeds the critical value @, = 2.5 
in Example 2 (right). 


In Algorithm 2, we choose initial guess U°-° 


1=0 j,k=1" Ci 


1 
/ cos[tn,: — (t) + sh)]L;(1 +e; — s)Ly(s)dsUe 11 jUP ,, 
63 


i= 1,2,3. 


(0,0,0)7,@, = 0.01 and 


m = 20. The maximum absolute errors for N = 4,8 and 5 = 0,10~® have 
been reported in Table 2. Also, Figures 5 and 6 show the absolute errors at 
the grid-points for N = 4,8 and 6 = 0,10-°. 

Now, we consider a special case of (3) with K(t, s) = 1 from [3] as follows. 


Example 2. [3] Consider the AVIE of the first kind as follows: 
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Figure 10: Log[RMSE] versus the number of iteration steps with N = 8,5 = 107+ 
for the outer loop in Example 2 (left). The value of 7 never exceeds the critical value 
@ = 2.5 in Example 2 (right). 
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Figure 11: The absolute errors with N = 4,6 = 0 at the grid-points in Example 2 (left). 


The absolute errors with N = 8,6 = 0 at the grid-points in Example 2 (right). 


N=4 N=4 N=8 N=8 
60 dS0* BS0 w= i0-* 


Ue, 4.52533 4.52527 2.37834 2.37832 
Us, 6.46103 6.46100 3.47984 3.47980 
Ue; 9.68703 9.68729 5.50843 5.50838 


Table 1: The solution of system (16) in Example 1 


g(t) = | u(t — s)u(s)ds, t € [0, 1, (18) 
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Figure 12: The absolute errors with N = 4,6 = 10~4 at the grid-points in Example 2 
(left). The absolute errors with N = 8,6 = 10~‘ at the grid-points in Example 2 (right). 
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Figure 13: The absolute errors obtained by method 1 [3] with N = 50,r = 4,5 = 0 at 
the grid-points in Example 2 (left). The absolute errors obtained by method 1 [3] with 
N = 100,r = 4,6 = 0 at the grid-points in Example 2 (right). 


N 6=0 i=10-° 


4 4.74 x 107? 4.74 x 107 
8 6.54 ~x 1073 1.35 « 10-7 


Table 2: The maximum absolute errors in Example 1 
30 — $t+ + 3 + 30? + st and the exact solution u(t) = 


In Example 2, assume that m = 2,N = 4,8,6 = 0,10~+, and the col- 
location parameters as cy = 0.6,co = 1. For n = 0, we solve the obtained 
nonlinear system by the double iteration process (Algorithm 1) with the ini- 
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Figure 14: The absolute errors obtained by method 1 [3] with N = 50,r = 4,6 = 1074 
at the grid-points in Example 2 (left). The absolute errors obtained by method 1 [3] 
with N = 100,r = 4,6 =10~‘ at the grid-points in Example 2 (right). 


tial guess ue = (1,1)7 and the parameters a = 0.1, Imax = 30000, @ = 2.5 
and e€ = 10+. In what follows, for n = 1,...,N —1, we solve the obtained 
linear system by the Lavrentiev m times iterated regularization method with 
initial guess U2 = (0,0)",a, = 0.01 and m = 20. The maximum absolute 
errors for N = 4,8 and 6 = 0,10~* have been reported in Table 3. 


N 6=0 =i" 


A. 342% 10-2 3.56 x 10-? 
8 8.22% 10-9 9.76 x 10-3 


Table 3: The maximum absolute errors in Example 2 


We also consider a local regularization technique from [3] by method 1 for 
the auto-convolution integral equation of the first kind (18) and report the 
maximum absolute errors for N = 50,100, r = 4 and 6 = 0,10~4 in Table 4. 


N 6=0 i=i0+ 


50 342 x10 3.43% 10-7 
100 1.71 x 10-7 3.01 «x 10-7 


Table 4: The maximum absolute errors obtained by method 1 [3] in Example 2 


Similar to Example 1, in Figures 7-10, we show the number of the termi- 
nation of the process in the outer loop and observe that 7 never exceeds the 
critical value @. = 2.5. Also, Figures 11 and 12 represent the absolute errors 
at the grid-points for N = 4,8 and 6 = 0,10~*. The absolute errors obtained 
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by method 1 [3] with N = 50,100,r = 4,6 = 0,10~4 at the grid-points are 
shown in Figures 13 and 14. 


4 Conclusion 


In this paper, we considered the numerical collocation method based on piece- 
wise polynomials to solve the generalized version of the AVIE of the first kind 
as an ill-posed problem. We obtained two ill-posed nonlinear and linear sys- 
tems. The double iteration process and the Lavrentiev m times iterated 
regularization method have been considered nonlinear and linear systems, 
respectively. Numerical examples demonstrated the validity and efficiency of 
the proposed method. In our future work, we will investigate the existence, 
uniqueness, and structure of the solution related to the generalized version 
of the first-kind AVIEs similar to Theorem 1. 
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